Piano systems and methods for the enhanced display of the hands of a pianist

ABSTRACT

In one embodiment, a method for the enhanced display of the hands of a pianist playing a piano, including: (a) recording at least one video stream of at least one hand of a pianist playing a piano; and (b) while the pianist is playing the piano, using at least a portion of the piano as a display for displaying the video stream.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a United States National-Stage Application, filedunder 35 U.S.C. § 371, of Patent Cooperation Treaty Application SerialNo. PCT/US2013/061714, filed on Sep. 25, 2013, which claims the benefitof and priority to U.S. Provisional Patent Application Ser. No.61/705,291, filed Sep. 25, 2012, the disclosures of both of which arehereby incorporated by reference in their entirety.

TECHNICAL FIELD

The present invention relates to musical performances and, morespecifically but not exclusively, to the enhancement of musicalperformances by improving an audience's ability to visualize one or moreaspects of the performance, such as the hands of a pianist.

DESCRIPTION OF THE RELATED ART

At a concert or recital involving piano, both performers and audienceshave an interest in the audience being able to watch the pianist'shands. It has conventionally been difficult or impossible for mostaudience members to do so, except for those who sit on the left side ofthe concert hall—and, even then, the view of the pianist's hands islimited, particularly for those sitting far from the stage.

Even in a smaller room, such as a classroom or auditorium, many audiencemembers who are seated closely enough to have a good view of the pianistare still unable to see the pianist's hands while the pianist isplaying, because the body of the piano itself or the body of the pianistobstructs their view.

Although it is possible to show a performer's hands on a separate,remote screen, such as using a projector, such equipment is not alwaysreadily available at all venues, especially in smaller concert halls,theaters, classrooms, and the like.

Moreover, projecting a pianist's hands on a separate screen requiresaudience members to look elsewhere, taking their eyes off the pianist,and having to choose whether to view either (i) the pianist and thepiano or (ii) the screen displaying the pianist's hands. In thisscenario, audience members typically must turn their heads back andforth to change views, making simultaneous viewing of the pianist, thepiano, and the screen displaying the pianist's hands difficult orimpossible.

SUMMARY OF THE INVENTION

To address the problems of the prior art, embodiments of the inventioninvolve using one or more portions of the piano itself, such as theunderside of the open lid, or a display attached to or integrated withinthe piano, as a display for displaying the pianist's hands to anaudience. In some embodiments, the invention provides a piano thatincludes a display for displaying the pianist's hands to the audience.In other embodiments, the invention provides a device or system adaptedto be attached to and used with a piano, for displaying the pianist'shands to the audience.

In one embodiment, the present invention provides a method for theenhanced display of the hands of a pianist playing a piano. The methodincludes: (a) recording at least one video stream of at least one handof a pianist playing a piano; and (b) while the pianist is playing thepiano, using at least a portion of the piano as a display for displayingthe video stream.

In another embodiment, the present invention provides a system for theenhanced display of the hands of a pianist playing a piano. The systemincludes a video recorder and a display. The video recorder is adaptedto record at least one video stream of at least one hand of a pianistplaying a piano. The display is adapted to use at least a portion of thepiano for displaying the video stream while the pianist is playing thepiano.

In a further embodiment, the present invention provides an apparatus forthe enhanced display of the hands of a pianist playing a piano. Theapparatus includes a video recorder and a projector. The video recorderis adapted to record at least one video stream of at least one hand of apianist playing a piano. The projector is adapted to display the videostream on the underside of the piano lid while the pianist is playingthe piano.

In still a further embodiment, the present invention provides a pianowith enhanced display of the hands of a pianist. The piano includes avideo recorder and a display. The video recorder is adapted to record atleast one video stream of at least one hand of a pianist playing thepiano. The display is adapted to show the video stream on at least aportion of the piano while the pianist is playing the piano.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates an exemplary piano system with enhanced display, inone embodiment of the invention;

FIG. 2 illustrates a block diagram of the electronic components of theexemplary piano system of FIG. 1;

FIG. 3 shows additional construction details of one embodiment of anextension rod;

FIG. 4a shows a stack of scored sheets used to create a screen, in oneembodiment of the invention;

FIG. 4b shows a stack of scored sheets used to create an extended screenportion for a horizontal screen, in one embodiment of the invention;

FIG. 5 illustrates another exemplary piano system with enhanced display,in one embodiment of the invention;

FIG. 6 illustrates another exemplary piano system with enhanced display,in one embodiment of the invention;

FIG. 7 illustrates another exemplary piano system with enhanced display,in one embodiment of the invention;

FIG. 8 illustrates another exemplary piano system with enhanced display,in one embodiment of the invention;

FIG. 9 illustrates another exemplary piano system with enhanced display,in one embodiment of the invention;

FIG. 10 illustrates another exemplary piano system with enhanceddisplay, in one embodiment of the invention;

FIG. 11 illustrates another exemplary piano system with enhanceddisplay, in one embodiment of the invention;

FIG. 12 illustrates another exemplary piano system with enhanceddisplay, in one embodiment of the invention; and

FIG. 13 illustrates another exemplary piano system with enhanceddisplay, in one embodiment of the invention.

DETAILED DESCRIPTION

FIG. 1 illustrates an exemplary piano system 100 with enhanced display,in one embodiment of the invention, in use with a conventional piano199. Piano system 100 includes a video camera 110 coupled to a displayprojector 120 via a video-input feed 115, along with a screen 130 and anextension rod 140.

As shown, video camera 110 is aimed at the keyboard (not visible in thedrawing) of piano 199. Video camera 110, which is supported, e.g., by atripod, is adapted to provide to projector 120, via video-input feed115, a continuous real-time video stream depicting the keyboard of piano199. Projector 120, which is supported, e.g., by a tripod, has an outputimage that is aimed at the underside of the open lid 189 of piano 199.

Screen 130 is affixed to the underside of lid 189 and provides a whitebackground surface for the output image of projector 120.

Extension rod 140 is a rod longer than the pivoting lid-support rodincluded as part of piano 199 and is desirably used in lieu thereof, toprop open the lid 189 of piano 199 and increase the opening angle beyondthe angle intended by the piano manufacturer. This provides severaladvantages, including a larger viewing surface for the audience and aviewing surface that faces the audience more directly, on the undersideof lid 189. Additionally, because of the short distance from projector120 to piano lid 189, the distance from projector 120 to the bottom ofthe image is much greater than the distance from projector 120 to thetop of the image, which causes the bottom of the image to be relativelylarger than the top of the image and creates a “keystone effect.”Raising the lid with extension rod 140 evens out these distances andreduces the keystone effect.

Accordingly, in system 100, while the pianist plays, his or her handsare displayed to the audience on screen 130. Audience members can thussee, in a single view, and without having to turn their heads back andforth, (i) the pianist, (ii) piano 199, and (iii) an enlarged view ofthe pianist's hands on screen 130.

As shown in FIG. 2, video-input feed 115 provides video signals forstreaming live video from video camera 110 to display projector 120.Video camera 110 and display projector 120 may, in alternativeembodiments, be coupled wirelessly, e.g., via WiFi network, a Bluetoothconnection, or the like. Although not shown in FIG. 2, one or moreadditional video-processing components may be included to permit theinclusion of functionality such as video manipulation (e.g., cropping,skewing, etc.), recording, and the like.

FIG. 3 shows additional construction details of one embodiment ofextension rod 140, although other designs are possible. As shown,extension rod 140 includes a first portion 141 having a rubber tip 145and a projecting end 143, and a second portion 142 having a rubber tip146 and a recess 144. Projecting end 143 of first portion 141 is adaptedto fit slidably and removably within recess 144 of second portion 142,such that a snug and rigid friction fit is created when first portion141 and second portion 142 are fully joined. In use, one end ofextension rod 140 is placed in a lid-support rod recess 179 within theunderside of lid 189, such that lid 189 rests on extension rod 140,while the other end of extension rod 140 is propped against a suitablelocation within the body of piano 199 (not visible in the drawings),most likely near the base of the pivoting lid-support rod included aspart of piano 199. In other embodiments, instead of using an extensionrod 140 that entirely replaces the pivoting lid-support rod included aspart of piano 199, an extension rod add-on could be used that increasesthe length of the pivoting lid-support rod included as part of piano199.

FIG. 4a shows a stack of scored sheets 400 used to create screen 130, inone embodiment of the invention. Sheets 400 are made from anelectrostatic material, such as dry-erase whiteboard film. As shown,sheets 400 are scored to match the contours of variously-sized pianolids and also to match the projected image of the piano keyboard, suchthat a view of the pianist's hands can be displayed generally verticallyand generally parallel to the continuous hinge of the piano lid, at alocation near the continuous hinge edge of the piano lid (as shown,e.g., in FIG. 1). In this manner, a single set of sheets 400 can be usedwith different pianos, such as by a traveling pianist who is usingdifferent pianos at different venues. The pianist simply removes one ofscored sheets 400, tears or cuts it along the scored lines that bestmatch the contours of the desired piano 199 to create a piece ofmaterial, which can then be applied by means of static cling to theunderside of lid 189 (and/or applied by means of an adhesive, clips, orother means), as shown in FIG. 1.

FIG. 4b shows a stack of scored sheets 400′ used to create an extendedscreen portion 130′ for a horizontal screen, in one embodiment of theinvention. Sheets 400′ are scored to match the contours ofvariously-sized piano lids and permit the view of the pianist's hands tobe generally horizontal and generally perpendicular to the continuoushinge of the piano lid (as shown, e.g., in FIG. 6), whereby both screen130 and extended screen portion 130′ are applied to the underside of lid189, either adjacent to one another, or overlapping one another, tocreate the horizontal screen.

FIG. 5 illustrates another exemplary piano system 500 with enhanceddisplay, in one embodiment of the invention. Piano system 500 includes asingle integrated portable unit 505 that houses a display projector 520and has a video camera 110 tethered to unit 505 via a flexible gooseneckarm 512, but in other respects is similar to piano system 100 of FIG. 1described above. As can be seen, the configuration of FIG. 5advantageously reduces the number of individual devices, tripods, andwiring employed relative to the configuration of FIG. 1.

FIG. 6 illustrates another exemplary piano system 600 with enhanceddisplay, in one embodiment of the invention. Piano system 600 includes atwo-piece projector system that keeps heat and light away from the pianobody, e.g., as disclosed in WO2013004742A1, which is incorporated byreference in its entirety herein, but in other respects is similar topiano system 100 of FIG. 1 described above. Piano system 600 includescontroller 605, which houses the bulb and fan components of theprojector, and projector head 620 coupled to controller 605 via one ormore interconnections 608 that may include optical and/or electricalconnections. As shown, in this embodiment, a video camera 610 is mountedto the piano lid via a flexible gooseneck arm 612, e.g., to provide analternative viewing angle.

FIG. 7 illustrates another exemplary piano system 700 with enhanceddisplay, in one embodiment of the invention. Piano system 700 includes atwo-projector system that separates the elongated image of the pianokeyboard from a single video camera into two parts and displays thoseparts adjacent to one another, but in other respects is similar to pianosystem 100 of FIG. 1 described above. Piano system 700 includescontroller 705, which receives streaming video from video camera 710,crops the image into two video streams, and sends those streams todisplay projectors 720 and 722, respectively. The projected images fromprojectors 720, 722 are displayed adjacently to form a single contiguousimage.

FIG. 8 illustrates another exemplary piano system 800 with enhanceddisplay, in one embodiment of the invention. Piano system 800 providesone exemplary method for mounting a screen 830 on the underside of pianolid 189, but in other respects is similar to piano system 100 of FIG. 1described above. In this embodiment, screen 830 is mounted between apair of adjacent support ribs 880 of piano lid 189, in vertical fashion,i.e., generally parallel to the continuous hinge of piano lid 189.

FIG. 9 illustrates another exemplary piano system 900 with enhanceddisplay, in one embodiment of the invention. Piano system 900 providesanother exemplary method for mounting a screen 930 on the underside ofpiano lid 189, but in other respects is similar to piano system 100 ofFIG. 1 described above. In this embodiment, screen 930 is mounted acrossand on top of a plurality of adjacent support ribs 980 of piano lid 189,in horizontal fashion, i.e., generally perpendicular to the continuoushinge of piano lid 189.

FIG. 10 illustrates another exemplary piano system 1200 with enhanceddisplay, in one embodiment of the invention. Piano system 1200 includesa rear-projection display projector 1220 that projects onto a screen1230 that is in part supported by piano lid 189 at a first attachmentpoint 1250 and in part supported by a support stand 1260, but in otherrespects is similar to piano system 100 of FIG. 1 described above.

FIG. 11 illustrates another exemplary piano system 1300 with enhanceddisplay, in one embodiment of the invention. Piano system 1300 includesa front-projection display projector 1320 that projects onto a screen1330 that is in part supported by piano lid 189 at a first attachmentpoint 1350 and in part supported by a support stand 1360, but in otherrespects is similar to piano system 100 of FIG. 1 described above.

FIG. 12 illustrates another exemplary piano system 1400 with enhanceddisplay, in one embodiment of the invention. Piano system 1400 includesa front-projection display projector 1420 that projects onto a screen1430 that is supported within one or more components of the piano body1479 by a pair of support stands 1460, but in other respects is similarto piano system 100 of FIG. 1 described above.

FIG. 13 illustrates another exemplary piano system 1500 with enhanceddisplay, in one embodiment of the invention. Piano system 1500 isdifferent from the embodiments discussed above in that the displayprojector and screen are replaced with a flat panel-type display 1520,such as a liquid crystal display (LCD), organic light emitting display(OLED), or inorganic light emitting display (ILED). Display 1520 mayhave an irregular shape, e.g., a shape that matches the contours ofpiano lid 189, as shown in FIG. 13, or a regular shape, such as arectangle or the like. In this embodiment, display 1520 may beintegrated within piano lid 189 as part of a manufactured piano product,as part of a replacement lid for an existing piano, or as a displayadapted for attachment to an existing piano lid 189, e.g., viamechanical means, such as clips or straps.

Alternative Embodiments

In alternative embodiments, the video camera may be situated differentlyand is desirably positioned so as to prevent obscuring the audience'sdirect view of the pianist and/or piano. For example, the camera may beanchored at one end of the piano keyboard and mechanically suspendedabove the keyboard, e.g., via a gooseneck support mechanism.Alternatively, the camera may be suspended from the ceiling, on atripod, or attached via wires or other means. In some embodiments,multiple cameras are used to create multiple video feeds of the pianokeyboard, and those multiple feeds are then processed and used to createa single video image for display to the audience. Multiple cameras maybe used, e.g., for left and right cameras, as redundant cameras forstability or sharpness enhancement, to permit display-angle changes orzoom changes during performance, and the like. In one embodiment, thevarious angles and/or various levels of zoom are determined by acomputer program that monitors and reacts to the sound waves of thepiano and/or the motion of the performer's hands. For example, if thecomputer notices that the left fingers are moving more than the right,then the camera would zoom in on that hand.

The projector may be disposed on a stand separate from and outside ofthe piano body, immediately in front of the piano. The projector mayalso be disposed within the piano body, such as atop an unoccupiedregion of the metal plate, or in another location that reduces oreliminates the ability of the audience to see the projector while inuse. A shelf may be temporarily mounted to the rim or case to hold theprojector at a suitable distance from the lid as a projection surface.Alternatively, the projector may be disposed elsewhere, such assuspended from the ceiling or affixed to another surface or component ofthe piano. In embodiments where the projector is disposed within thepiano body, an ultra-short-throw projector can be used, so that theimage is magnified substantially at a very short distance, and it isdesirable that the projector emit little or no heat that could causedamage to a piano. The connection between the camera and the projectorcan be wired or wireless.

The screen can be made from a variety of materials and be held onto theunderside of the piano lid using a variety of means. In one embodiment,the screen is a relatively thin plastic sheet held on by static cling.In another embodiment, the screen is a plastic sheet that is slightlysticky on one side but not sticky enough to leave a residue on the lidonce removed. In another embodiment, the screen is made of cloth that isstretched tight and held on using one or more clips or other fasteners.In another embodiment, the screen is made from whiteboard material. Inanother embodiment, the screen is a dark gray high-contrast projectionscreen. Instead of being removable, in some embodiments, the screen ispermanently affixed to or integrated into the lid, such as by the pianomanufacturer. In this scenario, piano manufacturers could sell pianosthat include a system consistent with embodiments of the invention,including an integrated high-contrast projection screen, projectorintegrated into or attached to the piano, and attached or integratedvideo camera.

In one embodiment, instead of using a projector and screen, a displaypanel, such as an LCD, organic or inorganic LED, or plasma display,affixed to or integrated into a portion of the piano itself, is used todisplay the pianist's hands. The display panel could be rectangular orcould alternatively be custom-shaped to conform to the shape of the lid,thereby maximizing usage of the area on the piano lid for display andproviding possible alternatives for horizontal, vertical, and diagonaldisplay of the keyboard.

It should be recognized that parts of the piano other than the open lidcould alternatively be used as a display. For example, the top of someupright pianos could be used as a display or attachment surface for adisplay. Alternatively, the side of a grand piano could be used as adisplay or attachment surface for a display.

Other real-time images could also be shown on the underside of the lid,such as a view of the printed music, other currently playing musicians,images of the pianist's use of the pedals, and the like. Multiplesurfaces of the piano could be used concurrently to display the sameview, to increase the number of locations from which the performer'shands can be seen. Alternatively, multiple surfaces of the piano couldbe used concurrently to display different views.

In some alternative embodiments, instead of recording and displaying atwo-dimensional image of the pianist's hands, a three-dimensional (e.g.,holographic) image of the hands of the pianist is displayed, e.g.,directly in front of the piano lid. In one such exemplary embodiment, ascreen fabricated from a photorefractive material capable of refreshingholograms in near-real time can be used with an array of regularcameras, each of which views the pianist's hands from a differentperspective. The information from those cameras is encoded onto afast-pulsed laser beam that interferes with another beam that serves asa reference, and the resulting interference pattern is written into thephotorefractive polymer, creating and storing the image. Each laserpulse records an individual holographic, three-dimensional pixel in thepolymer. The hologram fades away or can be erased by recording a newimage, creating a new diffraction structure, and deleting the oldpattern. The use of such an arrangement, or another three-dimensionaldisplay arrangement, results in the piano becoming a “container” for thedisplay of the pianist's hands, such that an enlarged, three-dimensionalimage of the pianist's hands appears to be contained and showcasedwithin or near the space defined by the body and lid of the piano.

Tripods for the video camera and/or projector may be used that hidewires within the pole of the tripod (i.e., so that wires enter and exitat only the top and bottom of the tripods), to reduce visual clutterfrom excess wiring.

It should be recognized that devices consistent with embodiments of thepresent invention may also have utility with instruments other thanpianos, including organs, electric pianos, marimbas, and otherinstruments having surfaces suitable for the display of an enhanced viewof one or more portions of a person playing the instrument.

Reference herein to “one embodiment” or “an embodiment” means that aparticular feature, structure, or characteristic described in connectionwith the embodiment can be included in at least one embodiment of theinvention. The appearances of the phrase “in one embodiment” in variousplaces in the specification are not necessarily all referring to thesame embodiment, nor are separate or alternative embodiments necessarilymutually exclusive of other embodiments.

Although the invention has been set forth in terms of the exemplaryembodiments described herein and illustrated in the attached documents,it is to be understood that such invention is purely illustrative and isnot to be interpreted as limiting. Consequently, various alterations,modifications, and/or alternative embodiments and applications may besuggested to those skilled in the art after having read this disclosure.Accordingly, it is intended that the invention be interpreted asencompassing all alterations, modifications, or alternative embodimentsand applications as fall within the true spirit and scope of thisdisclosure.

It will be further understood that various changes in the details,materials, and arrangements of the parts which have been described andillustrated in order to explain the nature of this disclosure may bemade by those skilled in the art without departing from the scope of thedisclosure as expressed in the following claims.

The embodiments covered by the claims in this application are limited toembodiments that (1) are enabled by this specification and (2)correspond to statutory subject matter. Non-enabled embodiments andembodiments that correspond to non-statutory subject matter areexplicitly disclaimed even if they fall within the scope of the claims.

1. A method for the enhanced display of the hands of a pianist playing apiano having a keyboard and a lid with an underside, the lid having atleast an open position and a closed position, the method comprising: (a)providing an imaging device in a position that is both above and to aside of the keyboard, such that the imaging device has a perspectiveview comprising the keyboard and at least one hand of the pianist,wherein closer keys appear larger than farther keys; (b) recording,using the imaging device, at least one video stream comprising at leasta portion of the perspective view; and (c) while the pianist is playingthe piano, using at least a portion of the lid as a support structurefor a display for displaying the video stream.
 2. The method of claim 1,wherein step (c) comprises using a projector to project the video streamon a surface of the underside of the piano lid.
 3. The method of claim2, wherein the display comprises a screen, and the method furthercomprises: (d) affixing the screen to the underside of the piano lid toprovide a background surface.
 4. A method for the enhanced display ofthe hands of a pianist playing a piano, the method comprising: (a)recording, using an imaging device, at least one video stream of atleast one hand of a pianist playing a piano, the piano having a lid withan underside, the lid having at least an open position and a closedposition; and (b) while the pianist is playing the piano, using at leasta portion of the lid as a support structure for a display for displayingthe video stream; and (c) affixing a screen to the underside of thepiano lid to provide a background surface for projection, wherein step(c) comprises applying a sheet of material that clings to at least aportion of the underside of the piano lid.
 5. The method of claim 4,wherein step (c) further comprises affixing the screen to the ribs ofthe piano lid.
 6. The method of claim 1, wherein step (b) furthercomprises operating projector bulb and fan components outside the pianobody while operating a projector head inside the piano body.
 7. Themethod of claim 1, wherein the piano lid comprises a flat panel display,and step (b) comprises displaying the video stream on the flat paneldisplay.
 8. The method of claim 1, further comprising propping open thepiano lid using an extension rod longer than the lid-support rodincluded as part of the piano, wherein when the pianist uses thelid-support rod, the piano lid is at a first angle, and when the pianistuses the extension rod, the piano lid is at a second angle greater thanthe first angle, such that the projected video stream is less distortedwhen the extension rod is used than when the lid-support rod is used toprop up the piano lid.
 9. The method of claim 9, wherein the extensionrod is portable and removable, and not permanently attached on thepiano.
 10. The method of claim 1, wherein step (b) comprises displayingthe video stream as a three-dimensional video stream.
 11. The method ofclaim 1, wherein: the keyboard displayed on the display has antrapezoidal shape, and the display's shape conforms to keyboard'strapezoidal shape, such that the display is not rectangular.
 12. Themethod of claim 11, wherein the display's shape is trapezoidal,five-sided, six-sided, or curved, such that the displayed trapezoidalkeyboard fits within the display.
 13. The method of claim 1, wherein thedisplay's shape comprises a curve conforming to a curve of the pianolid, such that the display is not rectangular.
 14. The method of claim1, further comprising the steps of: (d) providing at least one portablestand, (e) affixing the display to the underside of the piano lid andmounting the imaging device and a projector on the at least one portablestand before a performance; (f) removing the imaging device and theprojector from the at least one portable stand and removing the displayfrom the underside of the piano lid after the performance; and (g)transporting the imaging device, the projector, and the display toanother performance.
 15. A method for the enhanced display of the handsof a pianist playing a piano, the method comprising: (a) recording,using an imaging device, at least one video stream of at least one handof a pianist playing a piano, the piano having a lid with an underside,the lid having at least an open position and a closed position; and (b)while the pianist is playing the piano, using at least a portion of thelid as a support structure for a display for displaying the videostream; and (c) providing a sheet of material over at least a portion ofthe underside of the piano lid, the sheet forming at least a portion ofthe display, upon which sheet the video stream is projected.
 16. Themethod of claim 15, further comprising: (d) affixing the sheet to theunderside of the piano lid to provide a background surface forprojection.
 17. The method of claim 15, further comprising: (d) proppingopen the piano lid using an extension rod longer than the lid-supportrod included as part of the piano, wherein when the pianist uses thelid-support rod, the piano lid is at a first angle, and when the pianistuses the extension rod, the piano lid is at a second angle greater thanthe first angle, such that the projected video stream is less distortedwhen the extension rod is used than when the lid-support rod is used toprop up the piano lid.